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Abstract 

NF-kB, one of key regulators of inflammation, apoptosis, and differentiation, was 
found to have noisy oscillatory shuttling between the nucleus and the cytoplasm in 
single cells when cells are stimulated by cytokine TNFa. We present the analyti- 
cal analysis which uncovers the underlying physical mechanisms of this spectacular 
noise-induced transition in biological networks. Starting with the master equation 
describing both signaling and transcription events in NF-kB signaling network, we 
■ derived the macroscopic and the Fokker-Planck equations by using van Kampen's 

sysem size expansion. Using the noise-induced oscillatory signatures present in the 
power spectrum, we constructed the two-dimensional phase diagram where the noise- 
iduced oscillation emerges in the dynamically stable parameter space. 
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1 Introduction 

Oscillations are prevalent in biology. Neurons periodically fire pulses, cells undergo cell- 
cycle, and living organisms maintain their internal biological clock of about 24 hours (Mur- 
ray 1980). Strikingly, live cell imaging techniques revealed that biochemical reactions are 
likely to exhibit oscillatory behavior in single cells. For example, perpetual oscillations 
of a tumor suppressor protein p53 and its suppressor mdm2 have been observed in single 
cells when cells were exposed to ionizing UV irradiation (Lahav et al 2004). In addition, 
NF-kB, one of key regulators of inflammation, apoptosis, and differentiation, was found 
to shuttle between the nucleus and the cytoplasm of single cells when cells are stimulated 
by cytokine TNFa (Nelson et al 2004). Despite its universal appearance and its potential 
biological functions, the underlying physical mechanisms of such biological oscillations in 
noisy cellular environments have been neither discussed nor investigated to a mathemat- 
ically satisfactory degree. Sadly, most of publicly available investigations on the subject 
are based on numerical simulations and are quite limited in providing physical and math- 
ematical insights behind these fascinating natural phenomena. In this manuscript, we'd 
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like to present the analytical analysis which uncovers the underlying mechanisms of the 
spectacular noise-induced transition in one of biochemical oscillations. 

In biological, physical, and chemical systems, stochastic fluctuations (white noise) can 
induce oscillations in a dynamical system with an external periodic forcing (Steuer 2004; 
Pikovsky et al 1997; Neiman et al 1997; Gammaitoni et al 1998; Benzi et al 1982). This 
phenomena are called stochastic resonance where the background white noise amplifies the 
external periodic input signal and such an amplification is optimized at an intermediate level 
of noise. On the other hand, noise can also coherently induce oscillations without external 
periodic modulation. In this case the deterministic dynamical system has a stable fixed 
point, but has a long excursion in phase trajectory because of nearby dynamical instability; 
the system is constantly kicked off a stable fixed point by stochastic fluctuations and follows 
a deterministic phase trajectory at the natural frequency at which the system reaches its 
stable fixed point. This coherent noise-induced oscillation (NIO) was investigated in several 
model systems (Wiesenfeld 1985; Gang et al 1993; Mckane & Newman 2007). In addition, 
researchers revisited the previous studies of biological oscillations and investigated the 
effects of noise on the existence & emergence of limit cycles. The deterministic limit cycle 
emerges at some confined parameter space whereas stochastic fluctuations increase such a 
domain where noise not only stabilizes the limit cycle, but also induces oscillations at a 
parameter space where the deterministic dynamics produces a stable dynamics. 

We are interested in the effects of noise on the stable dynamics generated by negative 
feedback loops that are most commonly found in the biological networks. In the recent pa- 
per (Joo et al 2010), the authors presented NIO dynamic phenomena on a large-scale signal 
transduction network of NF-kB. A full stochastic two-compartmental model of the NF-kB 
signal transduction network consisting of 28 biochemical species and 71 kinetic parameters 
was investigated with the help of Gillespie stochastic simulations and, depending on the 
choice of the kinetic parameter values, yielded a phase diagram consisting of oscillations 
and damped-oscillations of NF-kB shuttling in carefully chosen two-dimensional parameter 
space. The authors successfully demonstrated the noise-induced oscillations of the NF-kB 
shuttling and identified the inherent stochastic fluctuations as the potential source of those 
fantastic stochastic phenomena. However, the full scale stochastic simulations with the 
large-scale size network and its nonlinear complexity, put a hard limit on our capability 
in investigating the characteristics of the bifurcation, the dependence of the NIO on the 
remaining parameter space. What is worse, the numerical analysis suffers from the lack of 
kinetic details, e.g., functional forms of reactions and associated kinetic parameter values. 
Thus, to overcome the difficulties described above, we like to perform stochastic analysis of 
a reduced network of NF-kB, assuming a linear response of the system to small perturbation 

In this paper, using the stochastic reduced order model of NF-kB signaling network and 
linear noise approximation, we present the underlying physical mechanisms of the NIO and 
show analytically the emergence of the NIO. We took into account the full stochastic nature 
of transcriptional processes in the model. We started with the master equation describing 
both signaling and transcription events, and then derived the macroscopic and Fokker- 
Planck equations by using van Kampen's sysem size expansion. First, we performed linear 
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stability analysis of macroscopic equations. Second, using the NIO signatures present in 
the power spectrum derived from Langevin equations, we constructed the two-dimensional 
phase diagram where the NIO emerges in the dynamically stable parameter space. 

2 Model description 

The full network consisting of 28 species and 71 kinetic parameters can be topologically 
reduced to an intermediately reduced network consisting of seven components, by using 
sensitivity analysis that calculates the correlation coefficients between kinetic parameters 
and the NF-kB dynamic response and eliminates insignificant kinetic parameters whose 
change doesn't significantly affect the NF-kB response as presented in Ref. (Joo et al 
2007). We further eliminate two fast variables, mRNA IkB and mRNA A20, whose half 
life are less than a half hour, obtaining a reduced network as shown in Fig. [TJ 

In more rigorous study of the stochastic dynamical system, one should start with a 
stochastic model of full NF-kB signaling network and adiabatically eliminate the "fast 
varying variables". However, the adiabatic elimination of the fast varying variables from 
the Makovian stochastic system leads to non-Markovian system, making analysis almost 
impossible and thus adiabatic elimination techniques are limited only to a small stochastic 
system. Thus, we take an non-rigorous but practical way of model reduction; we reduce 
the complexity or the dimension of the NF-kB signaling network by using various heuristic 
techniques and then the reduced network is converted to a stochastic minimal model. 

The current stochastic model neglects an intermediate step of protein synthesis, namely 
mRNA, that a typical stochastic model with modest level of complexity always contains. 
But, the mRNA and protein synthesis processes are too complicated to model them with a 
finite number of steps. Thus, we simply represent them with a single step (a single variable). 
Lastly, we include the stochastic fluctuations in DNA and protein NF-k interaction. 

The dynamic system under our consideration regulates the shuttling dynamics of NF- 
kB protein between cytoplasm and nucleus. In the absence of stimulus, the activated IKK 
is absent and NF-kB can exist either in a free form (NF-kB) or can be bound with inhibitor 
kB, forming a complex (IkB:NF-kB). The total amount of NF-kB, X , is conserved, en- 
abling us to omit the expression of a protein complex IkB:NF-kB from our model because 
the amount of protein complex IkB:NF-kB is simply X q -NF-k B. The free NF-kB can enter 
into nucleus with a rate k\ or moves out of nucleus with a rate k 2 by nuclear transport 
proteins. The liberated & translocated NF-kB into nucleus initiates mRNA & protein 
syntheses of IkB and A20 with rates ks and kio respectively, both of which forms negative 
feedback loops, negatively regulating the translocation of NF-kB into nucleus. The newly 
synthesized IkB bind to NF-kB with a rate k±, forming a protein complex IkB-NF-kB. 
Upon stimulus, IkB kinase (IKK) is activated with a constant rate, S ■ where S is stim- 
ulus strength and also is deactivated with a rate k^. This IKK induces IkB decay from 
IkB-NF-kB and liberates NF-kB with a rate k , which translocates NF-kB into nucleus, 
increasing the synthesis of negative regulators IkB and A20. In turn, A20 inactivates the 
activated IKK with a rate k 5 . A20 and IkB also decay with rates kg and k n respectively. 
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3 Derivation of chemical master equation 

We intend to use a probabilistic model of the NF-kB system to be able to capture unusual 
stochastic phenomena such as noise-amplified oscillation. Let us define the joint probability 
density Pt(rf) denoting the probability of the system to be in a state rj(t) = (C t , D t , X t , Y t , Z t ) 
at time t where Ct, D t , X t , Y t , and Z t denote the molecule number of IkB, A20, NF- 
/tB, NFnBn, and IKK proteins at time t, respectively. The time evolution of the joint 
probability is determined by the transition probability per unit time T(r]\r]'; t) of going from 
a state rj to a state rf . We assume that the transition probabilites do not depend on the 
history of the previous states of the system but only on the immediately past state. There 
are only a few transitions that are allowed to take place and their transition rates are 

To(...,X t , ...\...,X t + 1, ... 
Ti(...,X t ,Y t , ...\...,X t — l,Y t + 1, ... 
T 2 (...,X t ,Y t ,...\...,X t + l,Y t -l,... 

Tz(...,X t , ...\..., X t — 1, ... 

Ti(C t , —,X t , ...\C t , ...,X t — 1, ... 

T&(..., D t , Z t \..., D t , Z t — 1 
T e (...,Z t \...,Z t + l 
T 7 (...,Z t \...,Z t -l 

T%{C t , Y t , ...\Ct + 1, ■■■,Y t , ... 

T 9 (C t , ...\C t — 1, 

T w (..., D t , Y t , ...]..., D t + 1, Y t , ... 

T 11 (...,D t ,...\...,D t -l,... 

where Qc and Qn are the cytoplasmic and nuclear volumes of a typical cell, respectively. 
X Q is an initial and conserved molecule number of NF-kB protein. The above transition 
rates are provided as defined in Ref. (van Kampen 2001) and given in three terms in the 
following order: a reaction rate, a reactive volume where the reaction takes place, and the 
concentration (s) of all involved components, e.g., k\ ■ Qc • f^- All the above transitions 
occur at the cytoplasm except the transition T 2 . The transition T 2 (or 7\) describes a binary 
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(associative) reaction between a NF-kB protein in nucleus (or in cytoplasm) and a transport 
protein called "exportin" present in nucleus (or "importin" present in cytoplasm), leading 
to the transportation of NF-kB protein into cytoplasm (or into nucleus). The reactive 
volume is thus nuclear volume Qn (or cytoplasmic volume Qc) and assuming a constant 
concentration of importin and exportin being independent of the system's variables, their 
concentrations are absorbed into reaction rates. Two transitions, T 8 and T 10 , describe a 
complex mRNA and protein synthesis in a single term and those syntheses begin from 
the reaction between nuclear NF-kB and DNA in nucleus and ends at the production of a 
protein out of Ribosome in cytoplasm. Thus, the reactive volume of these two transitions is 
the cytoplasmic volume. In fact, these two transitions oversimplify very stochastic nature of 
transcription and translation. A more realistic model is provided and analyzed in appendix 
A. 

The stochastic process specified by the transition rates in Eq. ([I]) is Markovian, thus we 
can immediately write down a master equation governing the time evolution of the joint 
probability Pt(f])- The rate of change of the joint probability Pt(f]) is the sum of transition 
rates from all other states rf to the state f], minus the sum of transition rates from the 
state t] to all other states r]': 



dP t (v) 
dt 



(E~ x - 1)T (..., X t , ...\...,X t + l, t)P t (rj) (2) 

+ (E x E Y l - l)Tx(..., X t , Y t , ...|..., X t — l,Y t + 1, t)P t (rj) 

+ (E~ l E Y - 1)T 2 (..., X t , Y t , ...|..., X t + 1, Y t - 1, t)P t (v) 

+ (E x - 1)T 3 (..., X t , ...|..., X t - 1, t)P t {v) 

+ (E X E C - l)T 4 (a, X t , ...\C t -l, X t - 1, t)P t (rj) 

+ (E z - 1)T 5 (..., D t , Z t \..., D t , ...,Z t -l; t)P t (rf) 

+ {E z l -l)T & {...,Z t \...,Z t + l ] t)P t {r L ) 

+ (E z -l)T 7 {...,Z t \...,Z t -V,t)Pt{rj) 

+ (E- 1 - l)T s (C t , Y t , ...\C t + I, Y t , t)P t (rf) 

+ (Ec-l)T 9 (Ct,...\Ct-l,...)Pt(r,) 

+ (E~ x - 1)T 10 (..., D t , Y t , ...\..., D t + 1, Y t , ...; t)P t (rj) 

+ (E D - l)T n (..., D t , ...\..., D t - 1, t)P t (rj) 

where E^ is a step operator which acts on any function of a according to E^f(a ± 1, ...) = 
f(a±l,...). 



4 System size expansion of the chemical master equa- 
tion 

In this section we will apply van Kampen's elegant "system size fi-expansion method" 
to the chemical master equation in Eq. (J5]). This van kampen's f2-expansion method not 
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only allows us to obtain a deterministic version of the stochastic model in Eq. (j2J) but also 
enables us to find Gaussian corrections to the deterministic result. We choose two system 
sizes, cytoplasmic volume Qc and nuclear volume Qn, and expand the master equation in 

1 /2 1/2 

order of Qq and . A required condition for valid use of ^-expansion is the stability of 
fixed points and restricts us to perform this analysis only inside of the dynamically stable 
region. 

For large and finite cytoplasmic and nuclear volume, Qc an d we would expect 
P{rj) to have a finite width of order Vt 1 ^ 2 . The variables (X, Y, C, D, Z) are stochastic 
and we introduce new stochastic variables £,y, 6c, £d, £,z)'- X = xflc + V^c£,x, 
Y = yn N + ^n N ^ Y , C = cVlc + V^c^c, D = dVlc + V^c^D, and Z = zVt c + \/^ciz- These 
new stochastic variables represent inherent noise contribute to deviation of the system from 
the macroscopic dynamical behavior. 

The new joint probability density function H t is defined by n t (£) = Ptij]). Let us define 
the step operators which change the state a to a + 1 and therefore £ a into £ a + Q}/ 2 , 
so that the continuous approximation of the step operator is 

where Q becomes Qc f° r cytoplasmic component a and for nucleoplasmic a. The 
time derivative of the the joint probability Pt{rj) in Eq. (T5]) is taken at a fixed state i], 
which implies that the time-derivative on both sides of a = Vta + fi 1 ' 2 ^ should lead to 
d^ a /dt = — Q 1 / 2 da/dt. Therefore, 

* " & jfe'nz * * ^ 

The initial condition for the above parabolic PDE is Pt=o(i]) = S VtV0 . When the Eq. (T5]) 
is expanded in order of Vt 1 ^ 2 and fi^f 2 , we can collect several powers of Vt]l 2 and Vt 1 ^ 2 . 
The macroscopic equations emerge from the terms of order f2^ 2 and Q 1 ^ 2 and the linear 
Fokker-Planck equation is obtained from the terms of order and Q° N . 
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5 Emergence of the macroscopic equations 



By matching the terms in order of Vt 1 ^ 2 in Eqs. (j2J) and (j3J), we can identify the macroscopic 
equations as follows: 

k (x - x(t) - y{t)/K v )z t - kix{t) + k 2 y{t)/K v - k 3 x(t) - k 4 c(t)x(t) (5) 

kxx(t)K v - k 2 y{t) 

k$y(t) — kgc(t) — k±c{t)x{t) 

hoy{t) - k n d(t) 

S ■ k 6 — k 7 z(t) — k$d{t)z(t) 

The above macroscopic equations are nothing but the deterministic equations of the cor- 
responding stochastic model in the limit of infinitely large Q, i.e., in the limit of negligible 
fluctuations. 

The steady state solutions of the macroscopic equations can be obtained by setting 
the left-handed sides of the Eq. (J5}: y = kiK v x/k 2 , c = kik$K v x / (k 2 k$) , z = k§S/{k 7 + 
kik 5 k w K v x / (k 2 ku)) . The steady state solutions of x are the roots of the cubic equation, 
i.e., dxt/dt = and only one of three roots are positive real number and biologically feasible 
solution. We perform a linear stability analysis by small perturbation of the dynamic system 
from the feasible steady state solution, i.e., Sx(t) = x(t) —x. We rewrite the Eq. |5]in terms 
of this vector 5x(t): d5x(t)/dt = M ■ 5x{t). The stability of the steady state of the Eq. ([5]) 
is solely determined by the Jacobian matrix M: 
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where M u = — k z — k\ — k 3 — k^c, M 12 = {k 2 — k z)/ 'y/lQ, M i3 = —k^x, Mi 5 = k (xo — 
x - y/K v ), M 21 = k X \[K~ v , M 22 = -k 2 , M 31 = -k 4 c,_M 32 = k 8 VK^, M 33 = -k A x - kg, 
M 42 = Aaov^, M 44 = -k u , M 54 = -k 5 z, M 55 = -k 5 d - k 7 . 

The characteristic equation \M — EX\ is the fifth order polynomial equation and thus 
has five roots. The steady state of the dynamical system is stable when the real parts of 
all the roots are negative. Now for the macroscopic equations in Eq. ([5]), the three roots 
are always negative real numbers within the biologically feasible domain of the kinetic 
parameters under our consideration whereas the other two roots form a pair of complex 
conjugate whose real part undergoes a sign change as a function of the kinetic parameters. 
Thus, oscillation of this NF-kB signaling network arise from Hopf bifurcation mechanism. A 
two- variable bifurcation diagram shown in Fig. |2|A) is constructed by numerically solving 
the characteristic equation. When both total NF-kB concentration and volume ratio of 
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cytoplasm to nucleoplasm increases along the diagonal direction in Fig. 0(A), the real 
parts of two complex conjugate roots are changed from negative to positive values and the 
onset of the Hopf bifurcation takes place at Kv Hop f = 3.754..., giving rise to the emergence 
of a limit cycle. 
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6 A linear Fokker-Planck Equation 

The next-to- leading order terms, in the power expansion of the master equation, give 
a partial differential equation for the time evolution of the probability distribution n t (£), 
which has the form 

dU t dA a (i)U t d 2 Tl t 

where A a (£) = J2p M^p, ot = X,Y,C, D, Z , and M is a Jacobian marix of the Eq. (jHJ) 
and B are provided as below: 



B 



where the elements of both matrices M and B are fully determined by the steady state 
solution of the macroscopic equations, denoted by a: Bu = k Q z(xo — x — y/K v ) + k\x + 
k 2 y/K v + k 3 x + k^xc, B 12 = B 21 = -2kx^fK~ v x - 2k 2 y/^/K^, B 13 = B 31 = 2k A xc, B22 = 
k2y + kixK v , B33 = k^xc + k 8 y + kgc, -B44 = k w y + kxid, B 55 = k 5 dz + k^S + k 7 z. 

The probability distribution at next-to-leading order is completely determined by two 
5x5 matrices. A a (£) remain linear functions of the ^ and the B a p remain independent of 
them. Even though it is a characteristic of a large Q expansion for a single compartmental 
model that M is the Jacobian matrix which determines the stability at a fixed point. The 
partial differential equation is a linear Fokker-Planck equation, a continuous version of the 
master equation and can be solved exactly, given the initial condition that Il t= o = — £o)- 
The resulting solution of the probability distribution is a multi-variate Gaussian (Van 
Kampen 2001). 

The form of Eq. (jBJ) is not so useful for this purpose, but fortunately there is a com- 
pletely equivalent formulation of the stochastic process which is ideally suitable for Fourier 
transformations. The linear Fokker-Planck equation for the probability distribution func- 
tion is readily converted to a set of stochastic differential equations of the Langevin type 
for the actual stochastic variables £. The equivalent Langevin equations are 

^ = M-f(t)+#), (7) 

where rji(t) is a Gaussian noise with zero mean and with a correlation function given by 

(Va(t)v P -(t , ))=B a$ 5(t-t). (8) 
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To search for noise-induced oscillations, one of the most useful diagnostic tools is the 
power spectrum P(u>) = (|£(a;)| 2 ), where £(oj) is the Fourier transform of £(£). Taking the 
Fourier transform of Eq. ([7]) gives 

- iul (w) = M a ■ ij H + ■ (9) 

3 

We obtain = J2j ^iji^Vji 00 ) where $y(iu;) is the inverse of —iu5ij — My. Averaging 
the squared modulus of & gives the power spectra 

n(u) = (\£i(u)\ 3 ) = ^^hb^Lh (io) 

where we have used $j-(zu;) = ico). Note that the power spectrum is completely 

determined by two matrices M and B in Eq. (J7j) and (jSJ). 

7 Power spectra and noise-induced oscillations 

In this section, we investigate the effect of noise on oscillatory pattern of nuclear NF-kB 
component in wildt ype as well as IkB knocked-out and A20 knocked-out mutants. All of 
our results are derived from the system size expansion and the small noise approximation 
and thus the presented results ae valid only when the system size is large and the fixed 
points of the macroscopic system are stable. 

In Fig. 2, we plot the power spectra as the volume ratio of cytoplasm to nucleus (Kv) 
changes from 1 to its bifurcation point, Kv Hop f = 3.754... along the diagonal direction in 
two model parameter space. By this way, we satisfy the stability condition required for 
the validity of van kampen's method. Below the Hopf bifurcation point Kv Hop * where 
the deterministic dynamical system should be stable, the noise induces the oscillation of 
nuclear NF-kB protein. The conditions for the exixtence of well-amplified NIO are (1) the 
peak of the power spectra is at non-zero resonant frequency and (2) the peak of the power 
spectra is much greater than its width which is approximated by the magnitude of the 
fluctuations of the protein copy number in the system. Clearly, these two conditions are 
satisfied in the power spectra in Fig. 2. In Fig. 2, non-zero resonant frequency where the 
power spectra has a peak is equivalent to the period of the stochastic time-series. When 
Kv = Kv Hop f , the peak of the power spectra takes place at about uj = 0.0005 sec -1 and 
thus the nuclear NF-kB oscillates with about 3.5 hours of periodicity. As the volume ratio 
increases, the peak of the power spectra occurs at smaller frequency value and thus the 
period of the oscillations of NF-kB protein concentration increases. 

Now, we knock out one of two negative feedback loops, A20 or IkB, and investigate if 
the oscillations of NF-kB are robust in such a deletion. This deletion experiment provide 
us a clear idea about which negative feedback loop drive the NF-fcB oscillations. For 
this numerical experiments, all the original kintic rate constants in the NF-kB system is 
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kept unchanged while setting to zero the rate governing the mRNA IkB synthesis for IkB 
knocked-out mutant and the rate of the mRNA A20 synthesis for A20 knocked-out mutant. 

In Fig. 3, even though IkB negative feedback loop is absent, the overall qualitative 
dynamic features are invariant: the similar deterministic bifurcation curve as well as the 
similar power spectra. The only difference is that the deterministically dynamical instability 
domain is reduced slightly. But, the NIO of the NF-kB is still observed just outside of the 
dynamical instability domain. But, in Fig. 4, when A20 negative feedack loop is knocked 
out, the entire phase plane is deterministically stable in the biologically feasible parameter 
domain. The inclusion of noise doesn't induce NIO of the NF-acB. 

8 Conclusion 

We investigate the underlying mechanism of the biological oscillations of the NF-kB sig- 
naling system by using a stochastic reduced order model and a small noise approximation. 
This analysis strongly hints that the noise-induced oscillation may be the source of the 
biological oscillations of NF-kB in single cells. First, the oscillations of NF-kB are driven 
by two negative feedback loops in deterministic dynamic system. Second, the stochastic 
fluctuations in the system induce the NF-kB oscillations at the point where the determin- 
istic system generates a stable dynamics because the noise can kick off the system away 
from its stable fixed point and the sytem takes a long excursive phase trajectory due to 
the closeby dynamic instability. The NIO of NF-kB is robut against the deletion of IkB 
negative feedback loop, but is not when A20 negative feedback loop is deleted. Thus, A20 
may be essentially required for NF-ftB oscillations in single cells. 

A Appendix: Fast transition approximation between 
NF-ftB protein and DNA for transcription of I^B 
and A20 

The five component model described in the transitions T 8 and T w in Eq. ([T]) oversimplifies 
the very stochastic nature of transcription and translation, starting from Y copy number 
of nuclear NF-kB and ending with creation of a protein C or D, into a linear model. The 
mathematical description and its analysis of a DNA-protein interaction becomes far more 
complicated when the exclusiveness of the DNA operator site is taken into account, i.e, 
once a DNA operator site for a gene C is occupied, the remaining proteins can access no 
longer to the same operator site unless it is unoccupied. Here we attempt to incorporate 
the probabilitic operator transition into the model in Eq. (TTJ) , by modifying especially two 
transitions, T 8 and T w . 

We briefly describe a probabilistic model of DNA-protein interactions between nuclear 
NF-kB and two IkB and A20 promoters. A Fig. [5] shows a transition between four different 
DNA operator states, i.e., four different combinations each of which consists of a state 
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of IkB promoter and one of A20 promoter. P[' s stands for a joint probability of having 
a r state of IkB promoter and a s state of A20 promoter and r and s can take either 
(unbounded) or 1 (NF-ftB-bound). We take a simplest assumption: (1) a transition can 
change only the state of a single promoter. (2) The change of the state of a promoter 
isn't influenced by and doesn't affect the state of the other promoter. The transition from 
bounded IkB promoter state to IkB promoter-free state is denoted by q and transition from 
IkB promoter-free to IkB promoter-bound state is by qi (likewise, ko and k\ for A20). By 
stating that A20 mRNA synthesis rate is a s and IkB mRNA synthesis rate is /3 r regardless 
of the A20 promoter state, we can write a time evolution of a joint probability P[' S (C; D) 
of having the C and D copies of IkB and A20 mRNA: 



dP t r ' s (C,D) 
dt 



= « S (W;D-1)-P;- S (C;D)) + ^ S (C-1;D) (11) 
- P t r ' s (C; D)) + q r Pp s - qrP[' s + k s P[' S - k s P[' s 



where f = (r + 1) mod 2 and s — (s + 1) mod 2. There are four coupled equation like the 
above for the different combinations of (r, s), e.g., (0,0), (0,1), (1,0), (1,1). 

We define four new variables (marginal probabilities) among which only one variable 
will survive and the others will go extinct in the limit of fast transition (which parameter?). 

W t {C-D) = Y^ pr ' S ^ D ) ( 12 ) 

s,r 

X t {C-D) ee A; 1 (P°' + P 1 '°)-A;o(P ' 1 + P 1 ' 1 ) 
Y t (C;D) ee qi (P°>° + P ' 1 ) - qoiP 1 ' + P 1 ' 1 ) 

Z t (C;D) ee (k 1 + q 1 )P > + (k + q )P 1 > 1 -(k o + q 1 )P°> 1 -(k 1 + q )P 1 > 



Here W, X, Y, and Z measures are four unique combinations which can be made of two 
groups, each group being composed of a choice of two original states. X, Y, and Z describes 
the inflow and the outflow between those two groups denoted by the respective transition 
rates and will be nullified In the long time limit because the steady state flow between 
two chosen groups should be balanced. After the substitution of P r ' s with new variables 
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W, X, Y, and Z, we obtain time evolution equation of a new variable W t (C; D) as follows: 



(13) 

dmM) = gog^ft _ + m„ + kiai _ 

at q + q\ k + «i 

+ rirWi ^ - 1) - *t(C; D)) + - 1; Z>) - F t (C; £>)) 

fco + «i % + qi 

= q ° Po + qi ^ (W t (C — 1;D) — W t (C; D)) + ^ + ^ (W t (C; D - 1) - W t (C; D)) 

qo + qi k + fa 

+ ] ^^^^{W t {C ] D)-2W t {C ] D-l) + W t {C ] D-2)) 

(k + fay 

+ ~ f, l)2 (W t (C; D) - 2W t (C - 1; £>) + W t (C7 - 2; D)) 

The time-evolution equations of the other three variables, X, Y, and Z, rapidly approaches 
their respective quasi-steady states in the limit of fast transition (we can show dX/dt =- 
7X+... in the limit of large 7 value.). The expressions in the last two lines are obtained 
from setting the time evolution equations of X and Y to zero and assuming the second 
derivatives of X, Y, and Z with respect to C and D (See my notes for details). 

Then, we will perform a small noise approximation of a master equation describing fast 
operator transition presented in Eq. ( Tl3l) . We define three new transitions which decribe 
the association and the dissociation of the nuclear NF-kB proteins with two distinct DNA 
promotors for gene IkB and A20 and the DNA-state dependent protein synthesis. 

5 1 = 5° i n N (^)[DNA} = 5° 1 Y t (14) 



5 = 5° o n N [DNA} = 5° n N 
,RPII S 
f2jv 



7i/o = l° 1/o n c (-—)[DNA]= 1 ° 1/o n c 



where 6 can be either q for IkB promotor or k for A20 promotor and 7 can take either 
a for IkB protein synthesis or /3 for A20 protein synthesis whose transitions are depicted 
in Fig. [5l We separate the protein-DNA interactions from the actual transcription events 
which involve RNA polymerase II recruitement and transcriptional elongation, and mRNA 
synthesis, and protein production in Ribosome. Again, we lump two mRNA and protein 
syntheses into an effective event represented by 7 reaction for reduction of model dimension 
and simplicity of mathematical analysis. Here we assume a binary reaction between DNA 
promotor site and NF-kB protein for 5\ and between RNA polymerase and DNA operator 
site for 7. Also, we assume a constant concentration of DNA promotor in nucleus and that 
of RNA polymerase in nucleus and absorb each into the corresponding reaction rate. 

After substituting Y t with van Kampen's Ansatz and taking a continuum approximation 
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of a step operator, we can rewrite the Eq. (TT3"j) as follows: 



W t (C;D) du t (Z c ;£ D ) 



dt 



where 



dt 



C,D 



d 



+ 



Q2 B D d 2 B C 
+ 



^ n i/2 da du t (£ c ; £p) 



(15) 



c 



d 



c 



A D 

B D 
c d 

A c 
B c 
C c 



-dC 



D 



-r)C c 



D 



c 



+ k\a\y 

k + m 



(16) 



a: 



0\2 



yK v 



{K + *&/) 3 
+ 



g /3 + g?^ ?/ 

A c + <&<fM-Pl) 2 yK v 



7,0 



Y 



(gg + tfy) 3 



Qo + QiV 



in the derivation, we use a taylor expansion of the transition rate in the limit of a large 

k a +k a lV 



volume Q c , e.g., 1/(1 + ~ 1 - N k ^^ 2 
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Figure 1: Minimal model consisting of five proteins, IKK, cytoplasmic NF-kB (NF-kB), 
nuclear NF-kB (NF-/cBn), IkB, and A20. The synthesis of both A20 and IkB depends on 
the NF-/d3n. X's denote the reaction rates of the respective reactions. The external signal 
is received from the K 6 . 
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Figure 2: Phase diagram of NF-k oscillation on two model parameter space, the volume 
ratio of cytoplasm to nucleus (Kv) and the total NFKB concetration, for the wild type 
case. (A) shows the deterministic dynamical instability region where the fixed point of 
the macroscopic equations is unstable due to the Hopf bifurcation. (B) shows the power 
spectra in subcritical region along the diagonal direction as indicated as the dashed line in 
(A). (B) shows the power spectra at fixed value of Kv=2.5 in subcritical region. 
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Figure 3: Phase diagram and power spectra for the case of I/tB knocked-out mutant. (A) 
shows the phase diagram of NF-kB oscillations. (B) demonstrates the power spectra of 
nuclear NF-kB along the diagonal direction in (A) (dashed line). 
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Figure 4: Power spectra for the case of A20 knocked-out mutant. The phase diagram is 
not present because it contains a dynamically stable region. (A) shows the power spectra 
along the diagonal direction from Kv=l to Kv=10. 
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Figure 5: Transition between four states consisting of IkB and A20 promoters. P[ ,s stands 
for the probability having "r" state of the IkB promoter and "s" state of the A20 promoter. 
The transition between two states is denoted by a transition rate, either q or K. 
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